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Abstract 

We use Beck's quasi-additivity of Tsallis entropies for n independent subsystems to show that like 
the case of n = 2, the entropic index q approaches 1 by increasing system size. Then, we will 
generalize that concept to correlated subsystems to find that in the case of correlated subsystems, 
when system size increases, q also approaches a value corresponding to the additive case. 
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1 Introduction 

The formalism of non-extensive statistical mechanics has been developed over the past two decades as 
a beautiful generalization of ordinary statistical mechanics [H [21 [3] . It is based on the extremization 
of the Tsallis entropies 

i _ v w n q 

bq ~ q-1 ' (1) 
subject to suitable constraints. Here, the pt are the probabilities of physical microstates, and q is 
the entropic index. The Tsallis entropies reduce to the Boltzmann-Gibbs (or Shannon) entropy 
Sbg = Y^tLiPi^Pi f° r ? — ► 1. Growing experimental evidence indicates that q ^ 1 yields 
a correct description of many complex physical phenomena [1]. Tsallis' original suggestion was 
that this approach might be relevant for equilibrium systems with long-range interactions, but 
recently it was also pointed out that the formalism comes into play when systems are far from 
equilibrium. For example, for systems with fluctuating mean free path [6] and temperature or 
energy dissipation rate 0[8], Tsallis entropy may be relevant. The common feature in the examples 
of non-equilibrium systems mentioned is that the parameter q can be expressed by the relative 
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i± v ' r 1 , (2) 



l = (g-l) , 7 o, (4) 

v ^ y 'r?2\ I /r.\ 2 ' v ; 



variance of the fluctuations of a parameter X 

(X 2 ) - (X) 2 
{Xf 

provided that X is x 2 ( or gamma) distributed. Here the signs '+' ('— ') refer to q > 1 (g < 1) cases, 
respectively. From this point of view, the parameter q can be treated in such systems as a measure 
of fluctuations of a parameter I H|. 

Recently Beck [U] has suggested that for systems with fluctuations in temperature or energy 
dissipation rate, it is possible to make the Tsallis entropies quasi-additive by choosing different 
entropic indices at different spatial scales: 

S} + = tf +B . (3) 

where q is used for statistically independent identical subsystems A and B and q' for a composed 
system A + B. Eq. (|3|) for q close to 1 results in 

(B?) 

(B 2 ) + (B t y 

where Bi := liapi is the so called "bit number" [10], its negative expectation — < Bi >:= — J2iPi ^ n Pi 
is the Shannon entropy, and its variance — < Bf >:= — ^2iPi(lnpi) 2 is related to fluctuations in 
entropy. From Eq. (J^), it is clear that if q > 1, then q > q' > 1. This is what Beck interpreted as scale 
dependence. In other words, q' related to the composed system is less than q for each subsystem. 
Moreover, there are experimental examples showing that q is monotonously decreasing as a function 
of distance r [UJ. This idea has been used in [12] for independent non-identical subsystems with 
different entropic indices q\ and q2 , where a power law for entropic index was extended as a function 
of distance r. The Tsallis entropies are non-extensive (there is little difference between extensivity 
and additivity and in this paper we will use extensivity and additivity interchangably) . Given two 
independent subsystems A and B with probabilities pf and pf, respectively, the entropy of the 
composed system A + B (with probabilities p{^ +B = pfpf) satisfies 

Sf +B = + Sf + (1 - q)S^Sf . (5) 

Hence, for independent subsystems, there is additivity only for q = 1. More recently, another 
interesting concept has been reported [13JQ31II5]- Within this approach, equal and distinguishable 
subsystems can be strongly (globally) correlated such that for an adequate value of q ^ 1, S g becomes 
strictly additive. This means that additivity can exist even for correlated subsystems. 

There are three demands to be considered: independency of subsystems, the same q for the 
composed system and subsystems, and additivity of S q . These demands can not coexist except 
when q — ► 1 (Boltzmann-Gibbs entropy). Most early papers on non-extensive statistical mechanics 
deal with the first and the second demands and give up the third, Beck [9] keeps the first and the 
third, while Tsallis [13] considers the second and the third. 
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This paper is organized as follows. In section 2, Beck's work is generalized by including n 
subsystems instead of the original two subsystems. In section 3, we will attempt to use quasi- 
additivity property (Eq. (|3|) ) for correlated subsystems where q is assumed to be close to the additive 
case q*. In section 4, a method of finding probabilities satisfying additivity relation is presented. 
In section 5, some numerical solutions of quasi- additivity relation for two correlated equal binary 
subsystems are given and, finally, we have a conclusion in section 6. 



2 Quasi-additivity for n independent identical subsystems 

Quasi-additivity relation (Eq. ([3])) for n identical subsystems can be written as: 

n 

Sf* = S ^ +M+ - +A " , (6) 

r=l 

where S^ r is the entropy of one of the subsystems and S^ 1+ "' +An - g entropy of the composed 
system. Our assumption is that q and q' are different and are close to 1. Parallel to what Beck did 
[S], one can obtain 

Yip! = X^ ex p[(9 ~ i) 111 ^] = 1 + (<? - i)E^ ln ^ + o( q ~ ^E^ 1 * 1 ^) 2 +••• > ( 7 ) 

i i i i 

where the dots denote higher-order terms in q — 1. We can neglect the higher-order terms only if 

\(q-l)ln Pi \ «1, Vt (8) 

or, if alternatively, 

Pi » exp . (9) 

\q- 1| 

For example, for q = 1.1, it demands that pi » 4.54* 10 -5 and for q = 0.7, that pi » 0.036. Most 
of the time, probabilities are not so small and the estimated value of q is very close to 1. So Eq. ([9]) 
is satisfied. The sum of entropies of n identical subsystems can be written as 



£ = nS^ = -IL.(1 ~Y.Pl) = -n$>m^ - £(g - 1) ^ Pi (k Pj ) 2 - . . . , (10) 



• I 

and for the entropy of the composed system, we have 



q A 1 +A 2 +...+A n _ 1 /-i <i 



111 

q> — l • * — « - -w-an' ' ' 

ili2...i N 

where Pi 1 i 2 .,A N s are probabilities related to the composed system. Because q and q' are close to 1, 
the probabilities in different subsystems are nearly independent and, so 

e pL.., n = e piA---pi = c£ptr . (12) 

i\i2...iM iii2— iff i 

Using Eq. (J7|), we have 

(£ P f) n = l + n(g'-l)5>ln Pj + 5(^ , 



2 ' ri/ 2 

i i i 



(13) 
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where \n(q' — 1) \npi\ « 1, so that the higher-order terms are very small and negligible. Hence, the 
entropy of the composed system is obtained as follows: 

s A 1+ A 2+ ... + A n = ln ft 1) E«( ln ^) 2 " " 1)(E« ln ^) 2 + • ■ • • ( 14 ) 

i i i 

Quasi-additivity, thus, implies a relation between g and q' , namely, 



(15) 



(16) 



which can be rewritten in the following simplified form 

q' - 1 _ (Bf) 

q-l (S?) + (n-l)(^) 2 ' 

For re = 2, Eq. is recovered. The R.H.S. of Eq. ([16]) is positive and less than 1, so is & l so 
positive and we can write 

q' - 1 (5 2 ) 

0< - fl = — 5 — n>1 - ( 17 ) 

Eq. (fTTl) shows the dependence of q' on n. It also says that 

!1 < q' < q if q> I . . 

> i ■/ i (18) 
g<g'<l if g < 1 

If we assume that re increases by increasing scale r, it is clear from Eq. (117j) that for g > 1 (g < 1), 
is a strictly monotonously decreasing (increasing) function of scale r, so that by increasing 
system size, q' approaches 1. From Eq. ([2]), it is clear that the deviation of parameter q from 1 
can be interpreted as the fluctuations in temperature (or energy dissipation). Hence, approaching 
of q' to 1 by increasing n, indicates that fluctuations become negligible when system size increases. 
Assuming that re is proportional to volume (V oc r 3 ), in the limit n — > oo, it is clear from Eq. (|16p 
that 

[</-l| oc-oc^ . (19) 
re V 



The dependence of q on the size of the system has been studied in the hadronization process |16j . 
where q — 1 is introduced as a measure of total heat capacity of the hadronizing system \17\ [T8] : 
q — 1 = and then the assumption of C oc V results in: q — 1 = y, where q is q' in our discussion. 
However, it should be noted that the higher-order terms in (|13p are negligible, only if for each n we 
have 

\n{q - 1) hi ft | « 1 , (20) 
and that this condition should also be confirmed also in the limit re — * oo. By noting that * „ 



is positive, one can change equality in Eq. (|16p to the following inequalities: 

Kg' -1)| < \q-l\^^\n{q' -l)\n Pl \ < \q - ln Pi | . (21) 
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|q-i| 




Figure 1: Permissible region for \q — 1| plotted and colored as a function of p, for two-state subsystems with the 
probabilities p and 1 — p. 



Hence, condition (|20p is confirmed if 



1 



lnpi\ « 1 , \/p l 



(22) 



(J2iPi in Pi 

We use that condition to find permissible regions for binary subsystems, which have two possible 
states with the probabilities p and 1 — p. The regions have been shown in Fig. ([T|) for A = 0.4 and 
A = 0.2. These values of A give a nearly good approximation for the expansion (|13p . because we 
hold the terms which contain A 2 . 



In this section, we studied quasi-additivity relation for n independent identical subsystems. Our 
expansion makes sense only when q is close to 1. It should be noted that 1 is the value of q for which 
the Tsallis entropy becomes additive in independent subsystems. At this point, the question arise 
as to what we can say about correlated subsystems if we want to use quasi-additivity relation for 
them. The answer is provided in the following section. 



3 Quasi-additivity property for correlated identical subsystems 

As implied, if subsystems are independent, then the Tsallis entropy of a composite system becomes 
additive for q — > 1 (Boltzmann-Gibbs entropy) and for other values of q, the Tsallis entropy is not 
additive (|5|). However, when there are some correlations between subsystems, the Tsallis entropy 
may be additive for an appropriate g / 1. In this section, we consider n equal subsystems, which 
are specially correlated. So additivity condition is established for q* ^ 1: 

n 

]T Sp = S p +M+ - +A - . (23) 

r=l 

It may be interesting to use the quasi-additivity property (Eq. ©) for correlated subsystems. 
Similar to the case of independent subsystems where q and q' are assumed to be close to 1, namely, 
additive case, here also we assume that q and q' are close to the additive case q*. Supposing that 
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q = q* + 5, one obtains 

Erf = Erf* +s = E^ 9 * ex p 51nPl = Erf* + ^Erf* ln ft + ^ 2 Erf>^) 2 + • • • , (24) 



2 

iiz it % 

where only if |<5 lnpj| << 1, it is possible to neglect the higher-order terms in the expansion. We 
have a coefficient — ^ in the entropy and are interested in expanding it to powers of 5 

1 _ 1 _ g*-l-5 _ q*-l-6 | 5 2 
~q~^i ~ q* - 1 + 5 ~ ( q * - l) 2 - 5 2 ~ (q* - l) 2 ( + (q* - l) 2 + " 



g* - 1 (q* - ly (q* - 1) 
So the entropy S^ 7 " can be written as 

Sfr = sf-i = (26) 

= (i - Erf* - *Erf* ^< - ^ 2 Erf>^) 2 + • • -X^y - + 

and to second-order of 5 we obtain 



+ ... 



q q*-l \( q *-if q*-l J \ ( q * _ i) 3 (g* - l) 2 2 q* - 1 / 

(27) 

Similarly for the composed system, one can write 



oAl+A 2 +...+An _ ^ ^rfli2--tn _ g/ j; ^rflt2-in , ^rfli2-in ^ n Phh---i n \ 

<?' - 1 V ( g * _ J) 2 (jr* - 1 / 



+6 2 



/ I Hp\ x i 2 ...i n , Y.Pi 1 i 2 ...i n ^ n Pili2-..in _ l J2Pi 1 i 2 ...i n (l n Pili2-..in) \ 

I ( g *-l) 3 + ( g *-i) 2 2 a*-l 



where e = q' — q* , the sum is over all z r and -Pi 1 i 2 ...i n s satisfy extensivity condition (Eq. (|23p ). 
From the above relations, it is clear that the entropies S Ar and S Al+ '" +An in the first approximation 
are equal to S A * r and S A } + "' +An , respectively, where q* corresponds to the extensive case. Using 
quasi-additivity property, Eq. © in conjunction with Eq. (|23|) yields 

1-Eirf* , Eirf*lnpA „. 2 /l-Eirf* , Eirf'lnpi lEiPfOnpi) 



V f„* _ 1\2 _ 1 ) \ 



+ 



(q* - If ' q* - 1 J ' V (g* - l) 3 (g* - l) 2 2 g* - 1 

_ / I ~ Erf^...^ Y,Pj 1 i 2 ...j n ^ n Phi2-i n \ 
\ ( q *-\) 2 q*-l J 

~ Erfj^jn Hp\i 2 ...j n ^ n Phi2-in 1 Erf 1 i 2 ...j n (l n Kit2...i,J \ ^g") 

V ( g * _ i) 3 " ( g * _ i) 2 2 g* - 1 / ' 1 J 

The above relation can be rewritten as 

n<L4 - n<5 2 .B = eC - e 2 £> , (30) 
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where 



1 - T,iPl EiP? ln P i 
(q* - l) 2 q* ~ 1 



A= \~^\ Pi 2 ^ , (31) 



g* - 1 2 <f - 1 1 ' 

(g*-l) 2 g*-l ' 

^ = g _ l SPM 2 „, t „(lnp^ 2 ...iJ 2 

g* - 1 2 g* - 1 { } 



By defining 

Eq. (|30p can be rewritten as 



_£ _ q'-g* 

7 = t = ~ , 35 

o q — q* 

C nA 

D 1 2 -- 1 + — -nB = 0, (36) 
o o 



and its solution is obtained as follows 



It is observed that there are two solutions which contain the term Because 5 is small, 

becomes very large. But we are interested in finding finite solutions. If the coefficients of 5 and S 2 
in the radical are finite, then Eq. (|37p can be rewritten as 

C \C\ ( 2D An _ ,2DBn 2D 2 A 2 n 2 , r9 \ , . 

We can choose '+' or ' — ' signs from Eq. (j38H (depending on the sign of |^-|) so that the terms 
proportional to <5 _1 are eliminated and the solution is finite. It should be noted that when q* — > 1 or 
in cases where probabilities are very small so that their logarithms become infinite, the coefficients 
A, B, C and D can be infinite and, hence, Eq. f)38[) will not be valid. 



4 Finding probabilities which satisfy additivity relation 

We assumed that Pi 1 i 2 ...i ri s are the probabilities which make the Tsallis entropy additive, but there is 
a problem of finding those probabilities for each n. We restrict ourselves to n equal binary subsystems 
which have been investigated in [14] by Tsallis, Gell-Mann and Sato. Because our subsystems are 
binary, we have two possible microstates for each subsystem. Namely, for n = 1, the probabilities of 
microstates are pi = p and p2 = 1 — p. For n = 2, the probabilities are pn, p\2 = P21 and P22 and 
they satisfy the following relations 

Pu +P12 =Pi =P , (39) 
P21 + P22 = P2 = 1 - P ■ (40) 
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Eqs. (|39|) and (|40|) imply that for two subsystems ^4 and B, the sum of probabilities of the composed 
system A + B over microstates of B with a specified microstate of A results in the probability of 
that microstate of A, which is reasonable. Adding Eq. ([39]) to ([40]) yields 

Pn + 2pi2 +P22 = 1 • (41) 

In the case of independent subsystems, pu = p 2 ,pi2 = p(l — p) and P22 = (1 — p) 2 , so Eq. (|4T|) 
becomes trivial. Similarly, for three equal binary subsystems, we can write 

+ P112 = Pu , (42) 
P121 + P122 = P12 , (43) 
P221 + P222 = P22 , (44) 

and with the help of Eqs. (|41[) to (|44p . we obtain 

P111 + 3pn2 + 3pi22 + P222 = 1 , (45) 

where pn2 = P121 = P211 and p\22 = P212 = P221- Eqs. ([39]), (00]) and (02]) to (01]) are referred to 
as "scale-invariance" ( or scale-freedom) relations which can be generalized to n subsystems. They 
are called 'Leibnitz rule' in another notation p3] which relates the probabilities of n systems to the 
probabilities of n — 1 systems. Eq. (|45p can be generalized to n subsystems using 'Pascal triangle'. 
However, in every stage, the number of equations are 1 less than the number of unknown probabilities. 
So it is not possible to exactly find the probabilities. For example, for n = 2, we have two Eqs. 
([3"9"|) and (pTO]) and three unknown probabilities pu, p\2 and p22- Another equation that can be 
added to find our probabilities is additivity condition for entropy. In this way, for two equal binary 
subsystems, it can be written as 



and with the help of scale-invariance conditions, we have 

i-pf 1 -2{p- Pll y* -(i-2p+p u y* = i-jfl* -(i-pK 

q* -1 q* - 1 ' [ ' 

So pu, p\2 and ^22 are obtained to show that additivity can exist for correlated subsystems with 
q* 7^ 1. After finding the probabilities of two composed systems, it is possible to obtain the 
probabilities of three composed systems using scale-invariance and additivity conditions. These 
processes may be continued untill all the probabilities which make the entropy additive for each n 
are found. 
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5 Numerical solution of quasi-additivity relation for two correlated 
equal binary subsystems 



5.1 Exact solution: 

Similar to the additive case, quasi-additivity relation for two correlated identical binary subsystems 
can be written as 

s ^ b =2s£ => i-pfi-^;-^; =2 i-p g -(i-^ (48) 

9 q q — 1 q — 1 

where pu, p\2 = p — pn and P22 = 1 — 2p + pn are the probabilities related to the additive case and 
can be obtained from Eq. (|47|) . For a specified p and g (q is assumed to be close to q* as in the case 
of independent subsystems where q is close to 1), it is possible to find q' from Eq. (|48p and compare 
it with q. Also 7 is obtained from Eq. ([35]) . which we designate as 7 e to represent the word 'exact'. 

5.2 Approximate solution: 

It is not always possible to find the solution of quasi-additivity relation for n correlated subsystems 
exactly. One may, therefore, use the approximate solution given in (|37p . If we are now interested 
in finding q' or 7 for two equal binary correlated subsystems with specified p, q and q* using our 
approximate relation, then for A, B, C and D from Eqs. (|3ip to (|34p we obtain 
a = gg* lnp+(l-p)g' ln(l-p) 

(</* IT q* ~ 1 

= -A _ l ^(lnp) 2 + (l-pK(ln(l-p)) 2 

g* - 1 2 - 1 ' ^ j 

c _ 1 ~ Pu ~ 2Pl2 - P22 Pll ln PH + 2 Pl2 ln Pl2 + P22 ln P22 (5l) 

(q*-lf q*~l ' 

^ = C _ 1 Pn (In gi 1 ) 2 + 2p^ 2 (In y>i2 ) 2 + P22 ( ln P22 ) 2 ^ 52 ^ 
g* - 1 2 g* - 1 1 ' 

So from Eq. ([37]) . 7 is obtained and designated as j a , where a represents 'approximate'. We can, 

then, obtain q' from Eq. (|35p . 

5.3 Results 

The results are given in Tables 1 and 2 for q* = 0.3 and q* = 0.5 and for a given q close to q* as p 
changes from 0.1 to 0.9 in columns. pn,pi2 and P22 (the probabilities related to the additive case) 
are given in the three first columns. The results of the exact solution of quasi-additivity equation 
(section 5.1) and also approximate solution (section 5.2) are shown in the following columns. 
It is seen that in both approximate and exact solutions, 7 is positive and less than 1, namely, 
W ~ Q*\ < \q ~ Q*\ which means q approaches q* by increasing system size, or alternatively, spatial 
scales which are similar to independent subsystems where q' approaches 1 by increasing system 
size. It is an interesting result which means that by increasing spatial scales, fluctuations become 
negligible. 
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6 Conclusion 



In this paper, Beck's concept of quasi-additivity was used for n independent subsystems and the 
relation between q and q' was found for q and q' to be close to 1 (Eq. (fTBTl ). It strictly shows that 
by increasing n, or system size, q' approaches 1 so that q' — > 1 when n — > oo. The deviation of 
the parameter q from 1 in non-equilibrium systems describes the fluctuations in temperature (or 
energy dissipation) (Eq. ([2])). Approaching of q' to 1 by increasing n shows how fluctuations become 
negligible when system size increases. We have also used the quasi-additivity relation for correlated 
subsystems where it is assumed that q and q' are close to q* (specific value of q, which makes Tsallis 
entropy additive). It has been found that for the case of correlated subsystems, q also approaches 
q* which depicts a behaviour similar to the case of independent subsystems. The results for the two 
correlated equal binary subsystems have been given in the Tables. 
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q = 0.35 


q* = 0.3 










q = 0.25 


Pn 


P12 


P22 




"la 


p = 0.1 


0.09 


0.01 


0.89 




0.52 




0.09 


0.009 


0.89 


0.52 


0.52 


p = 0.3 


0.28 


0.02 


0.68 


0.32 


0.32 




0.28 


0.02 


0.68 


0.32 


0.32 


p = 0.5 


0.02 


0.48 


0.02 


0.26 


0.26 




0.02 


0.48 


0.02 


0.25 


0.25 


p = 0.7 


0.68 


0.02 


0.28 


0.32 


0.32 




0.68 


0.02 


0.28 


0.32 


0.32 


p = 0.9 


0.89 


0.01 


0.09 




0.52 




0.89 


0.01 


0.09 


0.52 


0.52 



Table 1: 7 e and 7 a are given for g*=0.3. The upper lines in the Tables correspond to q = 0.35 and the lower ones to 
q = 0.25. Results are rounded to two digits after decimal point. As shown, 7 e and ^ a are less than 1. 



q = 0.55 


q* = 0.5 










q = 0.45 


Pn 




P22 


le 


"la 


p = 0.1 


0.07 


0.03 


0.87 


0.62 


0.62 




0.07 


0.03 


0.87 


0.63 


0.63 


p = 0.3 


0.24 


0.06 


0.64 


0.43 


0.43 




0.24 


0.06 


0.64 


0.43 


0.43 


p = 0.5 


0.44 


0.06 


0.44 


0.37 


0.37 




0.44 


0.06 


0.44 


0.36 


0.36 


p = 0.7 


0.64 


0.06 


0.24 


0.43 


0.43 




0.64 


0.06 


0.24 


0.43 


0.43 


p = 0.9 


0.87 


0.03 


0.07 


0.62 


0.62 




0.87 


0.03 


0.07 


0.63 


0.63 



Table 2: 7 e and ^ a are given for g*=0.5. The upper lines in the Tables correspond to q = 0.55 and the lower ones to 
q = 0.45. Results are rounded to two digits after decimal point. As shown, 7 e and ^ a are less than 1. 
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